u 



V£> = 



ih patent 

Docket No. 1232^4459 

o 

Express Mail Label No. EFJ84682322US ^^ 
TN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

TTTTI TTY APPTJCATIQN AND APPLirATTON FEE TRANSMITTAL a,53(b))5^ 



ASSISTANT COMMISSIONER FOR PATENTS 
Box Patent Application 
Washington, D.C. 20231 

Sir: 

Transmitted herewith for filing is the patent application of 



Named Inventor(s) and 

Address(es): Hiroto OKA, 1-3, Miyazaki 6-chome, Miyamae-ku, Kawasaki-shi, Kanagawa-ken, 

Japan; Tsuneyoshi TAKAGI, 10-12-304, Nakanoshima 5-chome, Tama-ku, Kawasaki- 
ken, Japan 

For: Camera Control System 

Enclosed are: 

[X] 22_ page(s) of specification, _±_ page(s) of Abstract; _9__ page(s) of claims 

[X ] _8_ sheets of drawing [X ] formal [ ] informal 

[ ] Page(s)ofDeclaration and Power of Attorney 

[ ] Unsigned 

[ ] Newly Executed 

[ ] Copy from prior application 

[ ] Deletion of inventors including Signed Statement under 37 C.F.R. § 1.63(d)(2) 

[ ] Incorporation by Reference: The entire disclosure of the prior application, from which a copy of the 

combined declaration and power of attomey is suppliedherein, is considered as being part of the disclosure 
of the accompanying application and is incorporated herein by reference. 

[ ] Microfiche Computer Program (Appendix) 

[ ] page(s) of Sequence Listing 

[ ] computer readable disk containing Sequence Listing 

[ ] Statement under 37 C.F.R. § 1 .82 1 (f) that computer and paper copies of the Sequence Listing are 
the same 

[X] Claim for Priority Japanese Patent Apphcation No 9-207923 filed 8/1/97 



411752 1 



Docket No 1232-4459 



[ ] Certified copy of Priority Document(s) 
[ ] English translation documents 

[ ] Information Disclosure Statement 

[ ] Copy of 5 cited references w/ English Abstracts 

[ ] Copy of PTO- 1449 filed in parent application serial No. , 

[ ] Preliminary Amendment 

[ X] Return receipt postcard (MPEP 503) 

[ ] Assignment Papers (assignment cover sheet and assignment documents) 

[ ] A check in the amount of S40.00 for recording the Assignment. 

[ ] Assignment papers filed in parent application Serial No. • 

[ ] Certification of chain of title pursuant to 37 C.F.R. § 3.73(b). 
[ ] This is a [ ] continuation [ ] divisional [ ] continuation-in-part (C-I-P) of prior application serial no. 



[ ] Cancel in this application original claims of the parent application before 

calculating the filing fee. (At least one original independent claim must be retained for filing 
purposes.) 

[ ] A preliminary Amendment is enclosed. (Claims added by this Amendment have been properly 
numbered consecutively beginning with the number following the highest numbered original 
claim in the prior application. 

[ ] The status of the parent application is as follows: 

[ ] A Petition For Extension of Time and a Fee therefor has been or is being filed in the parent 

application to extend the term for action in the parent application until • 

[ ] A copy of the Petition for Extension of Time in the co-pending parent application is attached. 

[ ] No Petition For Extension of Time and Fee therefor are necessary in the co-pendmg parent 
application, 

[ ] Please abandon the parent application at a time while the parent application is pending or at a time when 
the petition for extension of time in that application is granted and while this application is pending has 
been granted a filing date, so as to make this application co-pending. 

[ ] Transfer the drawing(s) from the patent application to this application. 

[ ] Amend the specification by inserting before the first line the sentence: 

This is a [ ] continuation [ ] divisional [ ] continuation-in-part of co-pending application Serial 
No. filed . 



411752 1 



-2- 



nocketNo 1232-4459 



I. CALCULATION OF APPLICATION FEE (For Other Than A Small Entity) 













Basic Fee 




Number Filed 




Number Extra 


Rate 


$ 790.00 


lotal 
Claims 


27 


-20= 


7 


x$22.00 


$ 154.00 


Independent 
Claims 


7 


-3= 


4 


X82.00 


$ 328.00 


Multiple Dependent Claims 


[ ]yes 

[X]no 




Additional Fee = 
Add'l Fee 


$270.00 
NON^E 


$0 



Total: SI. 272.00 

[ ] A statement claiming small entity status is attached or has been filed in the above-identified parent 

application and its benefit under 37 C.F.R. § 1.28(a) is hereby claimed. Reduced fees under 37 C.F.R. 
§ 1 .9(F) (50% of total) paid herewith $ . 

[ X] A check in the amount of $ 1.272.00 for payment of the application filing fees is attached. 

[ ] Charge Fee(s) to Deposit Account No. 13-4500. Order No. . A DUPLICATE COPY OF 

THIS SHEET IS ATTACHED. 

[ X ] The Assistant Commissioner is hereby authorized to charge any additional fees which may be required for 
filing this application, or credit any overpayment to Deposit Account No. 13-4500, Order No, 1232-4459. 
A DUPLICATE COPY OF THIS SHEET IS ATTACHED. 



Respectfully submitted, 



MORGAN & FINNEgfAN,\L.L.P 



Dated: Julv30. 1998 



CORRESPONDENCE ADDRESS: 




Registration No 32. 53' 



MORGAN & FINNEGAN, L.L.P. 

345 Park Avenue 

New York, New York 10154 

(212) 758-4800 

(212) 751-6849 Facsimile 



411752J 



-3- 



- 1 - 



CFO 12887 US 



CAMERA CONTROL SYSTEM 



BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a camera control 

system and method for remotely controlling a camera 

suitable for use with video conference systems, camera 

monitoring systems and the like. 

Related Background Art 

The assignee of the present invention has proposed 

a system such as camera monitoring systems and video 

conference systems, by which a plurality of clients at 
remote sites not only can look at an image picked up by 
a video camera, but also can remotely controlled the 
image pickup direction, zoom magnification factor and 
the like of the video camera. 

In such a camera control system, if a plurality of 
clients access the same video camera to control it, the 
controls by these clients cannot be processed at the 
same time. Therefore, a system has been proposed in 
which only one client is given a "camera control right" 
at a time. 

In a camera control system incorporating the 
concept of "camera control right", a client may 
advertently input a camera control command before an 
acquisition request for the camera control right is 
entered . 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to solve 
the above problem and provide a system capable of 
controlling a camera by issuing an acquisition request 
5 for a camera control right even if a camera control 

command is input inadvertently before the acquisition 
request for the camera control right is issued. 

In order to achieve the above object, one aspect 
of the invention provides a camera control system 

10 capable of controlling a video camera connected to a 
camera server by transmitting a video camera control 
command from a client, wherein the client comprises: 
input means for inputting a video camera control 
command; and control request transmitting means for 

15 transmitting an acquisition request for a video camera 
control right to the camera server, when the video 
camera control command is input from the input means, 
and the camera server comprises: permission command 
issuing means for issuing a permission of the video 

20 camera control right to the client, in response to the 
acquisition request for the video camera control right 
issued by the control request transmitting means of the 
client; and control means for controlling the video 
camera in accordance with the video camera control 

25 command issued by the client. 

According to another aspect of the invention, 
there is provided a client capable of controlling a 
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video camera via a network, comprising input means for 
inputting a video camera control command; and control 
request transmitting means for transmitting an 
acquisition request for a video camera control right to 
5 the camera server, when the video camera control 
command is input from the input means. 

According to another aspect of the invention, 
there is provided a camera server for controlling a 
video camera in accordance with an input video camera 

10 control command, comprising control means for 

controlling the video camera in accordance with the 
video camera control command issued by a client granted 
a video camera control right; register means for 
registering the client granted the video camera control 

15 right; and reception means for receiving the video 
camera control command, wherein if the video camera 
control command from a client not registered in the 
register means is received, the register means 
registers the client if there is no other client 

20 registered, and the control means controls the video 
camera in accordance with the video camera control 
command , 

According to another aspect of the invention, 
there is provided a method of controlling a video 
25 camera by a client via a network comprising the steps 
of: inputting a video camera control command; and 
transmitting an acquisition request for a video camera 
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control right to the camera server, when the video 
camera control command is input. 

According to another aspect of the present 
invention, there is provided a method of controlling a 
5 video camera by a camera server in accordance with an 
input video camera control command, comprising the 
steps of: controlling the video camera in accordance 
with the video camera control command issued by a 
client granted a video camera control right; 

10 registering the client granted the video camera control 
right; and receiving the video camera control command, 
wherein if the video camera control command from a 
client not registered is received, the client is 
registered if there is no other client registered, and 

15 the video camera is controlled in accordance with the 
video camera control command. 

According to another aspect of the present 
invention, there is provided a storage medium storing a 
computer readable program for controlling a video 

20 camera by a client via a network, wherein the program 
comprises the steps of: inputting a video camera 
control command; and transmitting a control acquisition 
request for a video camera control right to the camera 
server, when the video camera control command is input. 

25 According to another aspect of the present 

invention, there is provided a storage medium storing a 
computer readable program for controlling a video 
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camera by a camera server in accordance with an input 
video camera control command, wherein the program 
comprises the steps of: controlling the video camera in 
accordance with the video camera control command issued 
5 by a client granted a video camera control right; 

registering the client granted the video camera control 
right; and receiving the video camera control command, 
wherein if the video camera control command from a 
client not registered is received, the client is 

10 registered if there is no other client registered, and 
the video camera is controlled in accordance with the 
video camera control command. 

The other objects and features of the present 
invention will become apparent from the following 

15 detailed description of embodiments when read in 
conjunction with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 a block diagram showing the structure of a 
20 camera control system according to an embodiment of the 
invention. 

Fig. 2 is a diagram showing an example of a 
displayed image on a bit map display. 

Fig. 3 shows the software configuration of the 
25 camera control system of the embodiment. 

Fig. 4 is a flow chart illustrating the operation 
to be executed by a camera server. 
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Fig. 5 is a flow chart: illustrating the operation 
to be executed by a client. 

Fig. 6 is a flow chart illustrating the detailed 
operations of Step S553 shown in Fig, 5. 
5 Fig. 7 is a flow chart illustrating the detailed 

operations of Step S553 shown in Fig. 5 different from 
those illustrated in Fig, 6. 

Figs. 8B and 8C are diagrams showing the 

structure of data packets. 

10 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Embodiments of the present invention will be 
described with reference to the accompanying drawings. 
In the embodiments, if a client (computer terminal) 

15 accessing a remote video camera and receiving video 

data enters a camera control command without acquiring 
a video camera control right, an acquisition request 
for the camera control right is automatically issued. 

Fig. 1 is a block diagram showing the structure of 

20 a camera control system according to an embodiment. In 
Fig. 1, reference numeral 1-1 represents a camera 
server, and reference numerals 1-2, 1-3, 1-4, . . . 
represent a client (computer terminal) which can 
control a video camera 1-11, the control operation 

25 being described later, A large number of clients can 
be connected to a network 1-0, 

The camera server 1-1 controls the video camera 1- 
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11 directly connec1:ed thereto. The camera server 1-1 
transmits video data supplied from the video camera 1- 
11 to an accessing client* 

Reference numeral 1-12 represents a video camera 
5 control circuit which controls an image pickup 

direction (pan and tilt angles), a zoom magnification 
factor and the like of the video camera 1-11, 
Reference numeral 1-13 represents a video capture which 
captures an image taken with the video camera 1-11, 

10 A secondary storage device 1-17 stores a program 

for controlling the operation of the camera server 1-1. 
Reference numeral 1-16 represents a RAM. A CPU 1-15 
loads the program in RAM 1-16 and executes it to 
thereby control the whole of the camera server 1-1. 

15 A network I/F 1-14 performs data transfer to and 

from a client via a network. Reference numeral 1-18 
represents a system bus connecting components of the 
camera server . 

Reference numeral 1-23 represents a bit map 

20 display for displaying an image or the like taken with 
the video camera 1-11. Reference numeral 1-26 
represents an input unit which is a pointing device 
such as a keyboard and a mouse. With this input unit 
1-26, a cursor displayed on the screen of the bit map 

25 display 1-23 is moved to a particular icon to enter a 
camera control command, 

A secondary storage unit 1-25 stores a program for 
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controlling the operation of the client 1-2 • Reference 
numeral 1-24 represents a RAM. A CPU 1-22 loads the 
program in RAM 1-24 and executes it to thereby control 
the whole of the client 1-2, 
5 A network I/F 1-21 performs data transfer to and 

from the camera server 1-1 via the network. Reference 
numeral 1-27 represents a system bus connecting 
components of the client 1-2, 

The other clients 1-3^ 1-4, . have a structure 
10 similar to that of the client 1-2 described above. 

Fig. 2 shows an example of an image displayed on 
the bit map display 1-23 of the client 1-2. 

A video display window 2-1 is used for displaying 
an image taken with a camera connected to an accessed 
15 camera server. A camera control window 2-2 is used for 
entering an acquisition request for the camera control 
right of an accessed camera or for entering a camera 
control command. 

Buttons 2-3a, 2-3b, 2-3c, 2-3d in the camera 
20 control window 2-2 are used for generating a control 
command of changing the image pickup direction to up^ 
down, right, or left direction. By using a mouse of 
the input unit 1-26, a cursor displayed on the screen 
is moved to a button corresponding to the direction to 
25 be changed, and clicked to thus enter a control command 
for the image pickup direction (pan and tilt angles). 
A scroll bar 2-4 is used for changing the zoom 
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magnification factor. By using the mouse, a button 2- 
4a is dragged to thus enter a control command for the 
zoom magnification factor, 

A control ON button 2-5 is used for issuing an 
5 acquisition request for the camera control right of an 
accessed camera (camera corresponding to an image 
displayed on in the video display window 2-1), by 
clicking this button, A control OFF button 2-6 is used 
for issuing a discard request for the camera control 

10 right now in possession, by clicking this button. 

A video ON button 2-7 is used for accessing the 
camera server 1-1 to receive an image taken with the 
camera 1-11. When this button 2-7 is clicked, image 
data is supplied from the camera server 1-1 and the 

15 image taken with the camera 1-11 is displayed on the 
video display window 2-1. A video OFF button 2-8 is 
used for stopping an access to the camera server 1-1. 
A display field 2-10 is used for displaying information 
on whether the client is acquiring the camera control 

20 right, or other information. 

Fig. 3 is a diagram showing the software 
configuration of the camera control system of the 
embodiment. In the camera server 1-1, software of a 
video transmission server 3-11 and a camera control 

25 server 3-12 runs. In the camera clients 1-2, 1-3, 1- 
4,..,, software of video display clients 3-21, 3-31, 
3-41, , 3-nl and camera control clients 3-22, 3-32, 
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3-42,..., 3-n2 runs. 

The video transmission server 3-11 performs video 
data capture and compression, and transmits video data 
to an accessed camera client. The camera control 
server 3-12 manages acquisition requests for the camera 
control right, discard requests for the camera control 
right and the like supplied from clients in order not 
to give the camera control right to a plurality of 
clients at a time. 

The camera control server 3-12 performs the camera 
control in accordance with a camera control command 
entered from a client having the camera control right 
(in the example shown in Fig, 3, client 1-2), the 
camera control command including an image pickup 
direction, a zoom magnification factor and the like. 
When the camera control is performed, the camera 
control server 3-12 broadcasts camera parameter 
information to all clients accessing the camera server 
1-1 at that time, the camera parameter information 
including current pan and tilt angles, a current zoom 
magnification factor and the like. 

The video display clients 3-21, 3-31, 3-41,..., 3- 
nl receive compressed video data transmitted from the 
video transmission server 3-11 via the network, expands 
it, and display the image taken with the camera. 

The camera control clients 3-22, 3-32, 3-42,..., 
3-n2 display the camera control window 2-2 on the 



display 1-21 to provide a user interface for inputting 
a camera control command- If the client has the camera 
control right, an input camera control command is 
transmitted to the camera server 1-1. 

The operation to be executed by the camera control 
server 3-12 will be described with reference to the 
flow chart shown in Fig. 4. A control program for this 
operation is stored in the secondary storage device 1- 
17, which is loaded in RAM 1-15 and executed by CPU 1- 
15. 

At Step S410, an initialization process of the 
video camera 1-11 is performed to set specific values 
as pan and tilt angles and as a zoom magnification 
factor, and thereafter the flow advances to Step S420. 
If any event occurs at Step S420, the flow advances to 
Step S430. An event includes a command from a client 
connected to the network, a command for an operation in 
the camera server 1-1, and the like. 

If the camera control right is being granted to 
some client at Step S430, it is checked from the issued 
event whether the client having the camera control 
right is to be deprived of the camera control right. 

In this embodiment, the client having the camera 
control right is deprived of the camera control right 
under the following conditions: when the client having 
the camera control right issues the discard request for 
the camera control right; when a predetermined time 
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elapes after the client was granted the camera control 
right; when the client having the camera control right 
is physically disconnected from the network; when a 
client having a priority order higher than that of the 
5 client having the camera control right issues an 

acquisition request for the camera control right; and 
other conditions . 

If the occurred event satisfies any of the above 
conditions at Step S430, the client having the camera 

10 control right is deprived of the camera control right 
at Step S430. At Step S432, a deprivation notice of 
the camera control right is transmitted to the client 
which was deprived of the camera control right. 

At Step S440 if an event such as an acquisition 

15 request for the camera control right is issued from a 

client, it is checked whether the client is granted the 
camera control right. In this embodiment, in addition 
to an event of the acquisition request for the camera 
control right, the camera control right is granted 

20 under the following conditions: when a standby state of 
camera control right acquisition is released which 
acquisition was requested by a client; if a client has 
previously reserved camera control right acquisition; 
if any client is not granted the camera control right 

25 and when only a camera control command issued from a 
client is received; and other conditions. 

If the occurred event satisfies any one of the 
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above conditions at Step S440, a client to be granted 
the camera control right is designated at Step S441. 
As the criterion for this designation, the camera 
control right may be granted to a client whose 
acquisition request for the camera control right was 
received earliest by the camera server, or to a client 
having the highest priority order among those clients 
issuing the acquisition request for the camera control 
right . 

At Step S442 the camera control right is granted 
to the designated client. At Step S443 a notice of 
granted camera control right is transmitted to the 
granted client • 

At Step S450 it is checked whether an acquisition 
request for the camera control right issued from a 
client is required to be registered, or whether a 
reservation for the camera control right issued from a 
client is required to be registered. If required, at 
Step S451 an acquisition request for the camera control 
right or a reservation for the camera control right is 
registered in a management list of the camera control 
server 3-12. At Step S452, a notice of registration is 
transmitted to the registered client. The management 
list registers therein information on a client granted 
the camera control right and on clients reserved for 
the camera control right. 

At Step S460 if an event is a camera control 
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command transmitted from a client granted the camera 
control right, then the flow advances to Step S461 
whereat the camera is controlled in accordance with the 
camera control command. At Step S462, parameters such 
as the image pickup direction (pan and tilt angles) and 
the zoom magnification factor of the controlled camera 
are broadcast to all clients accessing the camera 
server 1-1. 

The operation to be executed by the camera control 
client 3-22 of the client 1-2 of this embodiment will 
be described with reference to the flow chart shown in 
Fig. 5. A control program for this operation is stored 
in the secondary storage device 1-25, which is loaded 
in RAM 1-24 and executed by CPU 1-22. The clients 1-3, 
1-4,... execute an operation similar to the client 1-2. 

At Step S510, an initialization process is 
performed to initialize various parameters and flags, 
and thereafter the video ON button 2-7 is clicked to 
access the camera server 1-1. Next, an event is waited 
for at Step S520. 

At Step S530, if an acquisition request for the 
camera control right is entered by clicking the control 
ON button 2-5, it is checked whether a camera control 
right holding flag is OFF, i.e., whether the client 1-2 
has the camera control right. If not, the flow 
advances to Step S532 whereat an acquisition request 
for the camera control right is transmitted to the 
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camera server 1-1, whereas if the camera control right 
is being granted, it is not transmitted. 

At Step S540, if a discard request for the camera 
control right is entered by clicking the control OFF 
5 button 2-6, the flow advances to Step S541 whereat it 
is checked whether the camera control right holding 
flag is ON, i.e., whether the client 1-2 has the camera 
control right. If the camera control right is being 
granted, the flow advances to Step S542 whereat a 
10 discard request for the camera control right is 

transmitted to the camera server 1-1, whereas if not, 
the discard request for the camera control right is not 
transmitted so that any load is imposed on the network. 
It is checked at Step S550 whether a control 
15 command such as an image pickup direction command and a 
zoom magnification factor command is entered by 
operating upon the buttons 2-3a, 2-3b, 2-3c, 2-3d, or 
scroll bar 2-4. 

If the control command is entered, it is checked 
20 at Step S551 whether the camera control right holding 
flag is ON. If ON, i.e., if the camera control right 
is being granted, the entered camera control command is 
transmitted to the camera server 1-1 at Step S552. 

If the camera control right holding flag is not ON 
25 at Step S551, i.e., if the camera control right is not 
being granted, the flow advances to Step S553 
( processing 1 ) . 
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Fig. 6 is a flow chart illustrating the processing 
1 at Step S553 shown in Fig. 5. 

At Step 8601, an acquisition request for the 
camera control right is issued and transmitted to the 
5 camera server 1-1. At Step S602, the camera control 
command entered at Step S530 is stored in RAM 1-24. 

At Step S603, if the notice of granted camera 
control right is transmitted from the camera server, 
the camera control right holding flag is turned ON at 
10 Step S604 to notify the client of that the camera 

control right can be granted. At Step S605, the camera 
control command stored at Step S602 is read and 
transmitted to the camera server 1-1. 

With the above processes, when the camera control 
15 command is entered even if the client has no camera 
control right, an acquisition request for the camera 
control right is first issued and then the camera 
control command is transmitted after the notice of 
granted camera control right is received. 
20 Reverting to the flow chart shown in Fig. 5, it is 

checked at Step S560 whether an event is a notice of 
granted camera control right transmitted from the 
camera server 1-1. If the event is the notice of 
granted camera control right, the camera control right 
25 holding flag is turned ON and thereafter at Step S562 
the effect that the granted camera control right is 
granted, is displayed on the display 2-10. This 
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display may be performed by displaying a picture 
representative of a presence/absence of granted camera 
control right on a partial area of the display screen, 
or by changing the display style of the buttons 2-3a to 
2-3d and scroll bar 2-4 in accordance with a 
presence/absence of granted camera control right. 

At Step S580, it is checked whether an event is a 
notice of reservation of the camera control right and 
registration of the client. If the event is such a 
notice, the flow advances to Step S581 whereat the 
effect that the camera control right has been reserved, 
is displayed on the display 2-10. 

At Step S590, it is checked whether an event is a 
camera parameter notice from the camera server 1-1. If 
the event is such a notice, the noticed current image 
pickup direction including the pan and tilt angles is 
displayed on the display 2-10. 

As above, if a client enters a camera control 
command before the client is not granted the camera 
control right, the acquisition request for the camera 
control right is automatically issued and transmitted 
to the camera server so that the camera control command 
can be properly processed. 

Fig. 7 is a flow chart illustrating the processing 
1 at Step 8553 shown in Fig. 5 different from the 
operation illustrated in Fig. 6. 

At Step S701, when an acquisition request for the 
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camera control right is issued, the acquisition request 
for the camera control right as well as the camera 
control command entered at Step S550 is transmitted to 
the camera server 1-1. 
5 Figs. 8A to BC show the structures of packets for 

the camera control command to be transmitted from the 
clients 1-2, 1-3, 1-4, . . • . Fig. 8A shows the structure 
of a packet when a camera control command is 
transmitted to the camera server. Fig. 8B shows the 

10 structure of a packet when an acquisition request for 
the camera control right as well as a camera control 
command is transmitted. Fig. 8C shows the structure of 
packets, a packet for an acquisition request for the 
camera control right being first transmitted and in 

15 succession a packet for a camera control command being 
transmitted to the camera server. 

In Figs. 8A to 8C, a header stores information 
specific to the client such as an ID address of the 
client. A field 302 stores information specific to the 

20 client. A field 303 stores data necessary for an 
acquisition request for the camera control right. 

The packet shown in Fig. 8B stores information on 
an acquisition request for the camera control right and 
a camera control command, and is transmitted to the 

25 camera server at Step S702 in the flow chart shown in 
Fig. 7. 

For the packets shown in Fig. 8C, the packet 



storing information necessary for an acquisition 
request for the camera control right is first 
transmitted and in succession the packet storing 
information necessary for a camera control command is 
transmitted, respectively to the camera server at Step 
S702 in the flow chart shown in Fig. 7. 

In the operation to be executed by the camera 
control client illustrated in the flow chart of Fig. 7, 
the acquisition request for the camera control right 
and the camera control command are transmitted at the 
same time or in succession to the camera server. 
Therefore, the camera server can advantageously perform 
the camera control in accordance with the camera 
control command immediately after the client acquires 
the camera control right. 

In this embodiment, as shown in Fig. 2, the camera 
control command can control the image pickup direction 
and zoom magnification factor of the camera. Other 
camera control commands may also be used, such as a 
focus control command, a switch command between manual 
and automatic focus controls, and a shutter speed 
control command. Also in such a case, an acquisition 
request for the camera control right can be 
automatically issued and transmitted to the camera 
server as in the above embodiment, if the camera 
control right is not still granted when such a camera 
control command is entered. 
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Also in the above embodiment, although only a 
single camera server is connected to the network, a 
plurality of camera servers may be connected to the 
network and the camera control right for each video 
camera connected to each of the camera servers is 
requested. Also in such a case, the object of the 
embodiment can be achieved by automatically requesting 
the camera control right to each accessed camera server 
connected to the network even if the camera control 
command is entered before the camera control right is 
still not granted . 

In the embodiment described above, the camera 
server 1-1 notifies the acquisition of the control 
right of the video camera 1-11 to each client. 
Instead, the camera server 1-1 may not notify the 
acquisition of the control right of the video camera 1- 
11 to each client. 

In this case, the client transmits the control 
command for the video camera 1-11 by using the packet 
of the control command shown in Fig. 8A, Upon 
reception of the packet shown in Fig. 8A, the camera 
server 1-1 reads the ID address in the header 301 of 
the received packet to identify the client which 
transmitted the control command. 

In this case, the object of the embodiment can be 
achieved by performing any of the following operations: 
( 1 ) if there is currently no client which is granted 
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the camera control right, the camera server 1-1 grants 
the camera control right to the client which 
transmitted the control command and controls the video 
camera 1-11 in accordance with the control command, (2) 
if the camera control right is already granted to the 
client which transmitted the control command, the 
camera server 1-1 controls the video camera 1-11 in 
accordance with the control command, as usual, and (3) 
if the camera control right is already granted to 
another client, the control command other than that 
transmitted by the client with the camera control right 
is invalidated . 

The invention is also applicable to a system or 
apparatus whose computer (or CPU or MPU) runs to read 
and execute software programs realizing the functions 
of the above-described embodiment and stored in a 
storage medium. 

In this case, the software program codes 
themselves read from a storage medium realize the 
embodiment functions. Therefore, the storage medium 
storing such program codes, constitute the present 
invention. 

The storage medium storing such program codes may 
be a floppy disk, a hard disk, an optical disk, a 
photomagnetic disk, a CD-ROM, a CD-R, a magnetic tape, 
a non- volatile memory card, and a ROM. 

The scope of the invention also includes only the 
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case wherein the embodiment functions are realized by 
executing the program codes read by the computer but 
also the case wherein the embodiment functions are 
realized by the process, a part or the whole of which 
process is executed in accordance with the program 
codes, by an OS (operating system) on which the 
computer runs . 

Furthermore, the scope of the invention also 
includes the case wherein in accordance with the 
program codes stored in a memory of a function 
expansion board or unit connected to the computer 
supplied with the program codes, a CPU or the like of 
the function board or unit executes part or the whole 
of the actual tasks for realizing the embodiment 
functions . 

In applying the embodiments to a storage medium, 
the program codes corresponding to the flow charts 
described above are stored in the storage medium. In 
short, modules essential for the camera control system 
of this invention is stored in the storage medium. 

As described so far, according to the embodiment, 
an acquisition request for the camera control right is 
automatically transmitted to the camera server even if 
a camera control command is entered before the camera 
control right is still not granted. Accordingly, a 
user can uses the camera control system freely and with 
ease- 
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Many widely different embodiments of the present 
invention may be constructed without departing from the 
spirit and scope of the present invention. It should 
be understood that the present invention is not limited 
to the specific embodiments described in the 
specification, except as defined in the appended 
claims . 
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WHAT IS CLAIMED IS: 

1. A camera control system capable of controlling 
a video camera connected to a camera server by 
transmitting a video camera control command from a 
client, wherein said client comprises input means for 
inputting a video camera control command; and control 
request transmitting means for transmitting an 
acquisition request for a video camera control right to 
the camera server, when the video camera control 
command is input from said input means, 

and wherein the camera server comprises permission 
command issuing means for issuing a permission of the 
video camera control right to said client, in response 
to the acquisition control request for the video camera 
control right issued by said request transmitting means 
of said client; and control means for controlling the 
video camera in accordance with the video camera 
control command issued by said client. 

2. A camera control system according to claim 1, 
wherein if the client is not granted the video camera 
control right, said control request transmitting means 
transmits the acquisition request for the video camera 
control right . 

3, A camera control system according to claim 1, 
wherein the client further comprises: 
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storage means for storing the video camera control 
command input by said input means, the video camera 
control command according to the transmission of the 
acquisition request for the video camera control right; 
and 

control command issuing means for issuing the 
video camera control command stored in said storage 
means to the camera server, when a permission of the 
video camera control right is issued from said 
permission command issuing means. 

4. A camera control system according to claim 1, 
wherein said control request transmitting means 
transmits at the same time the acquisition request for 
the video camera control right and the video camera 
control command input by said input means. 

5. A camera control system according to claim 1, 
wherein said control request transmitting means 
transmits the acquisition request for the video camera 
control right and in succession the video camera 
control command input by said input means. 

6. A camera control system according to claim 1, 
wherein the video camera control command includes at 
least one of an image pickup direction and a zoom 
magnification factor of the video camera. 
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7. A client capable of con-trolling a video camera 
via a network, comprising: 

input means for inputting a video camera control 
command ; and 

5 control request transmitting means for 

transmitting an acquisition request for a video camera 
control right to the camera server, when the video 
camera control command is input from said input means. 

10 8* A client according to claim 7, wherein if the 

client is not granted the video camera control right, 
said control request transmitting means transmits the 
acquisition request for the video camera control right. 

15 9. A client according to claim 7, wherein the 

client further comprises: 

storage means for storing the video camera control 

command input by said input means, the video camera 

control command according to the transmission of the 
20 acquisition request for the video camera control right; 

and 

control command issuing means for issuing the 
video camera control command stored in said storage 
means to a camera server, when a permission of the 
25 video camera control right is issued. 



10. A client according to claim 7, wherein said 
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control request transmitting means transmits at the 
same time the acquisition request for the video camera 
control right and the video camera control command 
input by said input means. 

11. A client according to claim 7, wherein said 
control request transmitting means transmits the 
acquisition request for the video camera control right 
and in succession the video camera control command 
input by said input means. 

12. A client according to claim 7, wherein the 
video camera control command includes at least one of 
an image pickup direction and a zoom magnification 
factor of the video camera. 

13. A camera server for controlling a video 
camera in accordance with an input video camera control 
command, comprising: 

control means for controlling the video camera in 
accordance with the video camera control command issued 
by a client granted a video camera control right; 

register means for registering the client granted 
the video camera control right; and 

reception means for receiving the video camera 
control command, 

wherein if the video camera control command from a 
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client not registered in said register means is 
received, said register means registers the client if 
there is no other client registered, and said control 
means controls the video camera in accordance with the 
5 video camera control command. 

14. A method of controlling a video camera by a 
client via a network, comprising the steps of: 

inputting a video camera control command; and 
10 transmitting an acquisition request for a video 

camera control right to the camera server, when the 
video camera control command is input. 

15. A method of controlling a video camera by a 
15 client via a network according to claim 14, wherein if 

the client is not granted the video camera control 
right, the acquisition request for the video camera 
control right is transmitted. 

20 16. A method of controlling a video camera by a 

client via a network according to claim 14, further 
comprising the steps of: 

storing the input video camera control command, 
the input video camera control command being associated 
25 with the transmission of the acquisition request for 
the video camera control right; and 

issuing the stored video camera control command to 
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a camera server, when a permission of the video camera 
control right is issued. 

17. A method of controlling a video camera by a 
client via a network according to claim 14, wherein the 
acquisition request for the video camera control right 
and the input video camera control command are 
transmitted at the same time- 

18. A method of controlling a video camera by a 
client via a network according to claim 14, wherein the 
acquisition request for the video camera control right 
is transmitted and in succession the input video camera 
control command is transmitted. 

19. A method of controlling a video camera by a 
client via a network according to claim 14, wherein the 
video camera control command includes at least one of 
an image pickup direction and a zoom magnification 
factor of the video camera. 

20. A method of controlling a video camera by a 
camera server in accordance with an input video camera 
control command, comprising the steps of: 

controlling the video camera in accordance with 
the video camera control command issued by a client 
granted a video camera control right; 
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registering the client granted the video camera 
control right; and 

receiving the video camera control command, 
wherein if the video camera control command from a 
client not registered is received, the client is 
registered if there is no other client registered, and 
the video camera is controlled in accordance with the 
video camera control command. 

21. A storage medium storing a computer readable 
program for controlling a video camera by a client via 
a network, the program comprising the steps of: 

inputting a video camera control command; and 
transmitting an acquisition request for a video 

camera control right to the camera server, when the 

video camera control command is input. 

22. A storage medium according to claim 21, 
wherein if the client is not granted the video camera 
control right, the acquisition request for the video 
camera control right is transmitted. 

23. A storage medium according to claim 21, 
wherein the program further comprises the steps of: 

storing the input video camera control command, 
the input video camera control command being associated 
with the transmission of the acquisition request for 
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the video camera control right; and 

issuing the stored video camera control command to 
a camera server, when a permission of the video camera 
control right is issued. 

5 

24. A storage medium according to claim 21, 
wherein the acquisition request for the video camera 
control right and the input video camera control 
command are transmitted at the same time. 

10 

25. A storage medium according to claim 21, 
wherein the acquisition request for the video camera 
control right is transmitted and in succession the 
input video camera control command is transmitted - 

15 

26. A storage medium according to claim 21, 
wherein the video camera control command includes at 
least one of an image pickup direction and a zoom 
magnification factor of the video camera. 

20 

27. A storage medium storing a computer readable 
program for controlling a video camera by a camera 
server in accordance with an input video camera control 
command, the program comprising the steps of: 

25 controlling the video camera in accordance with 

the video camera control command issued by a client 
granted a video camera control right; 
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registering the client granted the video camera 
control right; and 

receiving the video camera control command, 
wherein if the video camera control command from a 
client not registered is received, the client is 
registered if there is no other client registered, and 
the video camera is controlled in accordance with the 
video camera control command. 
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ABSTRACT OF THE DISCLOSURE 

When a control command for a video camera is 
entered, a client issues an acquisition request for a 
video camera control right and a camera server issues a 
5 permission command for the video camera control right 
in response to the acquisition request for the video 
camera control right from the client, and controls the 
video camera in accordance with the control command 
from the client. 
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